Defining Mastery: Knowledge Tracing Versus N- Consecutive Correct Responses
نویسندگان
چکیده
Knowledge tracing (KT) is well known for its ability to predict student knowledge. However, some intelligent tutoring systems use a threshold of consecutive correct responses (N-CCR) to determine student mastery, and therefore individualize the amount of practice provided to students. The present work uses a data set provided by ASSISTments, an intelligent tutoring system, to determine the accuracy of these methods in detecting mastery. Study I explores mastery as measured by next problem correctness. While KT appears to provide a more stringent threshold for detecting mastery, N-CCR is more accurate. An incremental efficiency analysis reveals that a threshold of 3 consecutive correct responses provides adequate practice, especially for students who reach the threshold without making an error. Study II uses a randomizedcontrolled trial to explore the efficacy of various N-CCR thresholds to detect mastery, as defined by performance on a transfer question. Results indicate that higher thresholds of N-CCR lead to more accurate predictions of performance on a transfer question than lower thresholds of NCCR or KT.
منابع مشابه
Student Modeling from Different Aspects
..................................................................................................................................................... 1 Students vs. Skills: Partitioning Variance Explained in Learner Models ........................................... 2 The Opportunity Count Model: A Flexible Approach to Modeling Student Performance ............. 10 Enhancing the Efficiency and R...
متن کاملApplying Clustering to the Problem of Predicting Retention within an ITS: Comparing Regularity Clustering with Traditional Methods
In student modeling, the concept of “mastery learning” i.e. that a student continues to learn a skill till mastery is attained is important. Usually, mastery is defined in terms of most recent student performance. This is also the case with models such as Knowledge Tracing which estimate knowledge solely based on patterns of questions a student gets correct and the task usually is to predict im...
متن کاملApplying Clustering to the Problem of Predicting Retention within an ITS: Comparing Regularity Clustering with Traditional Method
In student modeling, the concept of “mastery learning” i.e. that a student continues to learn a skill till mastery is attained is important. Usually, mastery is defined in terms of most recent student performance. This is also the case with models such as Knowledge Tracing which estimate knowledge solely based on patterns of questions a student gets correct and the task usually is to predict im...
متن کاملA Data-Driven Framework of Modeling Skill Combinations for Deeper Knowledge Tracing
This paper explores the problem of modeling student knowledge in complex learning activities where multiple skills are required at the same time and combinations of skills might carry extra specific knowledge. We argue that in such cases mastery should be asserted only when a student can fluently apply skills in combination with other skills. We propose a data-driven framework to model skill co...
متن کاملOptimal and Worst-Case Performance of Mastery Learning Assessment with Bayesian Knowledge Tracing
By implementing mastery learning, intelligent tutoring systems aim to present students with exactly the amount of instruction they need to master a concept. In practice, determination of mastery is imperfect. Student knowledge must be inferred from performance, and performance does not always follow knowledge. A standard method is to set a threshold for mastery, representing a level of certaint...
متن کامل